arXiv:1501.05008vl [math.DS] 20 Jan 2015 


PTH MOMENT NOISE-TO-STATE STABILITY OF STOCHASTIC 
DIFFERENTIAL EQUATIONS WITH PERSISTENT NOISE* 

DAVID MATEOS-NUNEZ AND JORGE CORTESt 


Abstract. This paper studies the stability properties of stochastic differential equations subject 
to persistent noise (including the case of additive noise), which is noise that is present even at 
the equilibria of the underlying differential equation and does not decay with time. The class of 
systems we consider exhibit disturbance attenuation outside a closed, not necessarily bounded, set. 
We identify conditions, based on the existence of Lyapunov functions, to establish the noise-to-state 
stability in probability and in pth moment of the system with respect to a closed set. As part 
of our analysis, we study the concept of two functions being proper with respect to each other 
formalized via pair of inequalities with comparison functions. We show that such inequalities define 
several equivalence relations for increasingly strong refinements on the comparison functions. We 
also provide a complete characterization of the properties that a pair of functions must satisfy to 
belong to the same equivalence class. This characterization allows us to provide checkable conditions 
to determine whether a function satisfies the requirements to be a strong NSS-Lyapunov function in 
probability or a pth moment NSS-Lyapunov function. Several examples illustrate our results. 


1. Introduction. Stochastic differential equations (SDEs) go beyond ordinary 
differential equations (ODEs) to deal with systems subject to stochastic perturbations 
of a particular type, known as white noise. Applications are numerous and include 
option pricing in the stock market, networked systems with noisy communication 
channels, and, in general, scenarios whose complexity cannot be captured by deter¬ 
ministic models. In this paper, we study SDEs subject to persistent noise (including 
the case of additive noise), i.e., systems for which the noise is present even at the 
equilibria of the underlying ODE and does not decay with time. Such scenarios arise, 
for instance, in control-affine systems when the input is corrupted by persistent noise. 
For these systems, the presence of persistent noise makes it impossible to establish in 
general a stochastic notion of asymptotic stability for the (possibly unbounded) set 
of equilibria of the underlying ODE. Our aim here is to develop notions and tools to 
study the stability properties of these systems and provide probabilistic guarantees 
on the size of the state of the system. 


Literature review: In general, it is not possible to obtain explicit descriptions of the 
solutions of SDEs. Fortunately, the Lyapunov techniques used to study the qualitative 
behavior of ODEs SHl can be adapted to study the stability properties of SDEs 
as well BEET Depending on the notion of stochastic convergence used, there 
are several types of stability results in SDEs. These include stochastic stability (or 
stability in probability), stochastic asymptotic stability, almost sure exponential sta¬ 
bility, and pth moment asymptotic stability, see e.g., [l3, 14, 2(1 271. However, these 
notions are not appropriate in the presence of persistent noise because they require 
the effect of the noise on the set of equilibria to either vanish or decay with time. To 
deal with persistent noise, as well as other system properties like delays, a concept of 
ultimate boundedness is required that generalizes the notion of convergence. As an 
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example, for stochastic delay differential equations, [281 ] considers a notion of ultimate 
bound in pth moment 21] and employs Lyapunov techniques to establish it. More 
generally, for mean-square random dynamical systems, the concept of forward attrac¬ 
tor [ 9 } describes a notion of convergence to a dynamic neighborhood and employs 
contraction analysis to establish it. Similar notions of ultimate boundedness for the 
state of a system, now in terms of the size of the disturbance, are also used for differ¬ 
ential equations, and many of these notions are inspired by dissipativity properties of 
the system that are captured via dissipation inequalities of a suitable Lyapunov func¬ 
tion: such inequalities encode the fact that the Lyapunov function decreases along 
the trajectories of the system as long as the state is “big enough” with regards to the 
disturbance. As an example, the concept of input-to-state stability (ISS) goes hand 
in hand with the concept of ISS-Lyapunov function, since the existence of the second 
implies the former (and, in many cases, a converse result is also true 0). Al ong 
these lines, the notion of practical stochastic input-to-state stability (SISS) in 1211291] 
generalizes the concept of ISS to SDEs where the disturbance or input affects both 
the deterministic term of the dynamics and the diffusion term modeling the role of 
the noise. Under this notion, the state bound is guaranteed in probability, and also 
depends, as in the case of ISS, on a decaying effect of the initial condition plus an 
increasing function of the sum of the size of the input and a positive constant related 
to the persistent noise. For systems where the input modulates the covariance of 
the noise, SISS corresponds to noise-to-state-stability (NSS) Q, which guarantees, in 
probability, an ultimate bound for the state that depends on the magnitude of the 
noise covariance. That is, the noise in this case plays the main role, since the co- 
variance can be modulated arbitrarily and can be unknown. This is the appropriate 
notion of stability for the class of SDEs with persistent noise considered in this paper, 
which are nonlinear systems affine in the input, where the input corresponds to white 
noise with locally bounded covariance. Such systems cannot be studied under the 
ISS umbrella, because the stochastic integral against Brownian motion has infinite 
variation, whereas the integral of a legitimate input for ISS must have finite variation. 


Statement of contributions: The contributions of this paper are twofold. Our first 
contribution concerns the noise-to-state stability of systems described by SDEs with 
persistent noise. We generalize the notion of noise-dissipative Lyapunov function, 
which is a positive semidefinite function that satisfies a dissipation inequality that 
can be nonexponential (by this we mean that the inequality admits a convex 1Coo 
gain instead of the linear gain characteristic of exponential dissipativity). We also 
introduce the concept of pthNSS-Lyapunov function with respect to a closed set, 
which is a noise-dissipative Lyapunov function that in addition is proper with respect 
to the set with a convex lower-bound gain function. Using this framework, we show 
that noise-dissipative Lyapunov functions have NSS dynamics and we characterize the 
overshoot gain. More importantly, we show that the existence of a pthNSS-Lyapunov 
function with respect to a closed set implies that the system is NSS in pth moment 
with respect to the set. Our second contribution is driven by the aim of provid¬ 
ing alternative, structured ways to check the hypotheses of the above results. We 
introduce the notion of two functions being proper with respect to each other as a 
generalization of the notion of properness with respect to a set. We then develop a 
methodology to verify whether two functions are proper with respect to each other 
by analyzing the associated pair of inequalities with increasingly strong refinements 
that involve the classes /C, /Coo, and /C^ plus a convexity property. We show that 
these refinements define equivalence relations between pairs of functions, thereby pro- 
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ducing nested partitions on the space of functions. This provides a useful way to 
deal with these inequalities because the construction of the gains is explicit when the 
transitivity property is exploited. This formalism motivates our characterization of 
positive semidefinite functions that are proper, in the various refinements, with re¬ 
spect to the Euclidean distance to their nullset. This characterization is technically 
challenging because we allow the set to be noncompact, and thus the pre-comparison 
functions can be discontinuous. We devote special attention to the case when the set 
is a subspace and examine the connection with seminorms. Finally, we show how this 
framework allows us to develop an alternative formulation of our stability results. 

Organization: The paper is organized as follows. Section [2] introduces preliminaries 
on seminorms, comparison functions, and SDEs. Section [3] presents the NSS stabil¬ 
ity results and Section [4] develops the methodology to help verify their hypotheses. 
Finally, Section [5] discusses our conclusions and ideas for future work. 

2. Preliminary notions. This section reviews some notions on comparison 
functions and stochastic differential equations that are used throughout the paper. 

2.1. Notational conventions. Let R and M>o be the sets of real and non¬ 
negative real numbers, respectively. We denote by R n the n-dimensional Euclidean 
space. A subspace U C R" is a subset which is also a vector space. Given a ma¬ 
trix A £ R mxn , its nullspace A f(A) = {x £ R n : Ax = 0} is a subspace. Given 
V C R”, we denote by C(2?;R> 0 ) and C 2 (V\ R> 0 ) the set of positive semidefinite 
functions defined on T> that are continuous and continuously twice differentiable (if 
T> is open), respectively. Given V £ C 2 (R”;R> 0 ), we denote its gradient by VV and 
its Hessian by V 2 V. A seminorm is a function S : R ra —> R that is positively homo¬ 
geneous, i.e., S(Xx) = |A|^(a;) for any A £ R, and satisfies the triangular inequality, 
i.e., S(x + y) < S{x) + S(y) for any x,y £ R™. From these properties it can be 
deduced that S £ C(R";R> 0 ) and its nullset is always a subspace. If, moreover, the 
function S is positive definite, i.e., S(x) = 0 implies x = 0, then S is a norm. The 
Euclidean norm of x £ R™ is denoted by ||a:|| 2 , and the Frobenius norm of the matrix 
A £ R mxn is \A\jr = -^/trace {A T A) = i/trace (AA T ). For any matrix A £ R mxra , 
the function ||x||q = ||^4rc ||2 is a seminorm and can be viewed as a distance to Af(A). 
For a symmetric positive semidefinite real matrix A £ R nx ™, we order its eigenvalues 
as A max (A) = Ai(A) > ■ • • > A„(A) = A m ; n (A), so if the dimension of J\f(A) verifies 
dim (A/ - (A)) = k < n, then A n -k(A) is the minimum nonzero eigenvalue of A. The 
Euclidean distance from x to a set U C R” is defined by \x\ u = inf{||x — zi ||2 : u £ U}. 
The function |.|„ is continuous when U is closed. Given /, g : R> 0 R>o, we say that 
f(s) is in 0(g(s)) as s —> 00 if there exist constants k, so > 0 such that f(s) < Kg(s) 
for all s > so- 

2.2. Comparison, convex, and concave functions. Here we introduce some 
classes of comparison functions following [q] that are useful in our technical treatment. 
A continuous function a : [0,6) —> R>o, for b > 0 or b = 00 , is class tC if a(0) = 0 
and is strictly increasing. A function a : R>o —> R>o is class /Coo if a £ JC and is 
unbounded. A continuous function /1 : R> 0 x R> 0 —► M>o is class ICC if, for each 
fixed s > 0, the function r 1 —> p,(r, s ) is class /C, and, for each fixed r > 0, the function 
s 1 ^ y,(r, s ) is decreasing and lims^oo y(r, s ) = 0. If aq, «2 are class /C and the domain 
of oq contains the range of 0 : 2 , then their composition oq oa 2 is class /C too. If « 3 , oq 
are class /Coo, then both the inverse function 1 and their composition 013 o aq are 
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class 1C co- In our technical treatment, it is sometimes convenient to require comparison 
functions to satisfy additional convexity properties. A real-valued function / defined 
in a convex set A in a vector space is convex if /(Arc + (1 — A )y) < A f(x) + (1 — A )f(y) 
for each x, y £ A and any A £ [0,1], and is concave if —/ is convex. By Ex. 3.3], if 
/ : [a, 6] —> [f(a),f(b)] is a strictly increasing convex (respectively, concave) function, 
then the inverse function / -1 : [/(a),/(6)l —y [a, b] is strictly increasing and concave 
(respectively, convex). Also, following [2, Section 3], if /,g : R —> R are convex 
(respectively, concave) and / is nondecreasing, then the composition / o g is also 
convex (respectively, concave). 


2.3. Brownian motion. We review some basic facts on probability and intro¬ 
duce the notion of Brownian motion following [14]. Throughout the paper, we assume 
that (Cl,F, {Ai}t>o,P) is a complete probability space, where P is a probability mea¬ 
sure defined on the a -algebra F, which contains all the subsets of Cl of probability 0. 
The filtration {Ft(t>o is a family of sub-cr-algebras of F satisfying Ft C F ' s C F for 
any 0 < t < s < oo; we assume it is right continuous, i.e., Ft = n. 5 >t/ s for any t > 0, 
and Fq contains all the subsets of Cl of probability 0. The Borel tr-algebra in R", 
denoted by B n , or in [t 0 , oo), denoted by B([to, oo)), are the smallest cr-algebras that 
contain all the open sets in 1" or [to, oo), respectively. A function A : —> R” is F- 
measurable if the set (w £ Cl : A(w) £ A} belongs to F for any A £ B 11 . We call such 
function a (A-measurable) Revalued random variable. If A is a real-valued random 
variable that is integrable with respect to P, its expectation is E[A] = f Q X(ui)dP(u>). 
A function f : Cl x [to, oo) R" is F x ^-measurable (or just measurable) if the set 
{(w, t) £ Clx [t 0 , oo) : f(ui, t) £ A} belongs to F x B([t 0 , oo)) for any A £ B n . We call 
such function an {Atj-adapted process if /(.,t) : Cl —> R” is Aj-measurable for every 
t > to- At times, we omit the dependence on “u”, in the sense that we refer to the 
indexed family of random variables, and refer to the random process / = {/(t)}t>t 0 - 
We define £ 1 ([t 0 , oo); R") as the set of all Revalued measurable {Atj-adapted pro¬ 
cesses / such that P({w £ Cl : ||/(w, s )||2 ds < 00 }) = 1 for every T > to- 

Similarly, £ 2 ([to, 00 );R nxm ) denotes the set of all R raxm -matrix-valued measurable 
{.Ft(-adapted processes G such that P({w £ Cl 
every T > to- 


/t 0 IGf/h/ll/ds < 00 }) = 1 for 


A one-dimensional Brownian motion B : Cl x [to, 00 ) —> R defined in the probability 
space (fl,{Ft}t>o,P) is an {F t (-adapted process such that 

• P({wS Cl : B(w,t 0 ) =0() = 1; 

• the mapping B(w,.) : [to, 00 ) —> R, called sample path, is continuous also 
with probability 1; 

• the increment B(.,t) — B(.,s) : Cl —> R is independent of F s for to < s < 
t < 00 (i.e., if Sb = {w £ Cl : B (u,t) — B(w,s) £ (— 00 ,6)(, for b £ R, then 
P(A fl Sb) = P(A)P(S&) for all A £ F s and all b £ R). In addition, this 
increment is normally distributed with zero mean and variance t — s. 


An m-dimensional Brownian motion B : Cl x [to, 00 ) —y R m is given by B(w,t) = 
[Bi(w,t),... ,B m (w,t)] T , where each B^ is a one-dimensional Brownian motion and, 
for each t > to, the random variables Bi(t), ...,B m (t) are independent. 


2.4. Stochastic differential equations. Here we review some basic notions on 
stochastic differential equations (SDEs) following 141; other useful references are jj, 
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1711181 ]. Consider the n-dimensional SDE 

(2.1) dx(w, t) = /(x(w, + G(x(w, t),t)H(t) dB(w, t), 


where x(u>,t) £ R ra is a realization at time t of the random variable x(.,t) : f2 —> R ra , 
for t £ [£o,oo). The initial condition is given by x(ui,to) = Xg with probability 1 for 
some Xq £ R n . The functions / : R" x [io,oo) — > R”, G : R ra x [fo,oo) — > R nx? , 
and E : [f 0 ,oo) —► R 9Xm are measurable. The functions / and G are regarded as a 
model for the architecture of the system and, instead, E is part of the model for the 
stochastic disturbance; at any given time E determines a linear transformation of the 
m-dimensional Brownian motion {B(£)} t > to , so that at time t > tg the input to the 
system is the process {E(f)B(f)} t > to , with covariance J* g E(f)E(f) T ds. The distinction 
between the roles of G and E is irrelevant for the SDE; both together determine the 
effect of the Brownian motion. The integral form of (12.111 is given by 

x(u>,t)=x o + / /(x(w, s), s)ds + / G(x(w, s), s)E(s) dB(w, s), 

Jto Jto 

where the second integral is an stochastic integral Hi p. 18]. A Revalued random 
process {x(£)}t>t 0 is a solution of (12.111 with initial value xg if 

(i) is continuous with probability 1, {J-t}-adapted, and satisfies x(co,tg) = xg 
with probability 1, 

(ii) the processes {f(x(t),t)} t >t 0 and {G(x(t),t)} t >t 0 belong to £ 1 ([£ 0 , oo); M n ) 
and £ 2 ([f 0 ,oo);R" xm ) respectively, and 

(iii) equation (12.111 holds for every t > tg with probability 1. 

A solution {x(t)} t >t 0 of (12.11) is unique if any other solution {x(f)}t>t 0 with x(tg) = xg 
differs from it only in a set of probability 0, that is, P({x(t) = x(t) \/t> to}) = 1- 

We make the following assumptions on the objects defining EU to guarantee exis¬ 
tence and uniqueness of solutions. 

Assumption 2.1. We assume E is essentially locally bounded. Furthermore, for any 
T > tg and n > 1, we assume there exists Kt,u > 0 such that, for almost every 
t £ [io, T\ and all x,y £ R ra with max {||x|| 2 , ||t/|| 2 } < n, 

max{ || f{x,t) - , \G(x, t) - G(y,t)\% } < K T>n \\x - y\\\. 


Finally, we assume that for any T > tg, there exists Kt > 0 such that, for almost 
every t £ [tg,T] and all x £ R”, x T f(x,t ) + \\G(x,t)\% < Kt{ 1 + 

According to [ 3 , Th. 3.6, p. 58], Assumption 12.11 is sufficient to guarantee global 
existence and uniqueness of solutions of m for each initial condition xo £ R”. 

We conclude this section by presenting a useful operator in the stability analysis of 
SDEs. Given a function V £ C 2 (R";R> 0 ), we define the generator of EU acting on 
the function V as the mapping £[V] : R n x [to, 00 ) —(► R given by 

(2.2) £[V](x, t) = VV(x) T /(x,f) + i trace (e(£) t G(x, £) t V 2 V(x)G(x, £)E(i)) . 

It can be shown that £[V](x, t) gives the expected rate of change of V along a solution 
of (12.11) that passes through the point x at time t, so it is a generalization of the Lie 
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derivative. According to [14j, Th. 6.4, p. 36], if we evaluate V along the solution 
of (12.11) . then the process {V(a;(f))} t > to satisfies the new SDE 


V](a;(s), s)ds + f VV(x(s)) T G(x(s), s)E(s)dB(s). 

J to J to 

Equation (12.31) is known as ltd’s formula and corresponds to the stochastic version of 
the chain rule. 


(2.3) V(x(t)) = V(ar 0 ) 


C\ 


3. Noise-to-state stability via noise-dissipative Lyapunov functions. In 

this section, we study the stability of stochastic differential equations subject to per¬ 
sistent noise. Our first step is the introduction of a novel notion of stability. This 
captures the behavior of the pth moment of the distance (of the state) to a given 
closed set, as a function of two objects: the initial condition and the maximum size of 
the covariance. After this, our next step is to derive several Lyapunov-type stability 
results that help determine whether a stochastic differential equation enjoys these 
stability properties. The following definition generalizes the concept of noise-to-state 
stability given in [ 3 } . 

Definition 3.1. (Noise-to-state stability with respect to a set). The system (12.11) is 
noise-to-state stable (NSS) in probability with respect to the set U C R" if for any 
e > 0 there exist p £ ICC and 9 £ K, (that might depend on e), such that 

(3.1) p{ \x{t)\P > p(\x 0 \u,t-t 0 ) +6<(esssup|E(s)|^) ) < e, 

*- v t 0 <s<t ' > 

for all t > to and any Xq £ R". And the system (12.11) is pth moment noise-to-state 
stable (pthNSS) with respect to U if there exist p £ ICC and 9 £ 1C, such that 

(3.2) E[\x(t)\%] < fJi(\xo\u,t-to) + o(ess sup |E(s)|^ , 

v to<s<t J 


for all t > to and any Xo £ R™. The gain functions p and 9 are the overshoot gain 
and the noise gain, respectively. 

The quantity |E(t)|jr = ^trace (E(f)E(t) T ) is a measure of the size of the noise 
because it is related to the infinitesimal covariance E(f)E(t) T . The choice of the 
pth power is irrelevant in the statement in probability since one could take any 1C^ 
function evaluated at \x(t)\ u . However, this would make a difference in the statement 
in expectation. (Also, we use the same power for convenience.) When the set U is a 
subspace, we can substitute |.| M by ||.||a, for some matrix A £ R mxn with Af(A) = U. 
In such a case, the definition above does not depend on the choice of the matrix A. 

Remark 3.2. (NSS is not a particular case of ISS). The concept of NSS is not a 
particular case of input-to-state stability (ISS) 0] for systems that are affine in the 
input, namely, 


y = f(y,t) + G(y,t)u(t) o y(t)=y(to)+[ f(y{s),s)ds+ f G{y{s), s)u(s) ds, 

J to J to 

where u : [to, 00 ) R 9 is measurable and essentially locally bounded [22|, Sec. 
C.2]. The reason is the following: the components of the vector-valued function 
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f t G(y(s), s)u(s) ds are differentiable almost everywhere by the Lebesgue fundamen¬ 
tal theorem of calculus (lil. p. 289], and thus absolutely continuous ill p. 292] and 
with bounded variation [16t Prop. 8.5]. On the other hand, at any time previous 
to tk(t) = min{t,inf{s > to : ||x(s )||2 > fc}}, the driving disturbance of (12.111 is the 
vector-valued function G(x(s), s)£(s)dB(s), whose ith component has quadratic 
variation |lj|, Th. 5.14, p. 25] equal to 


r t k (t) m q 
J t() a —1 / i 


j =i 1=1 


Since a continuous process that has positive quadratic variation must have infinite 
variation @, Th. 1.10], we conclude that the driving disturbance in this case is not 
allowed in the ISS framework. • 


Our first goal now is to provide tools to establish whether a stochastic differential 
equation enjoys the noise-to-state stability properties given in Definition 13.11 To 
achieve this, we look at the dissipativity properties of a special kind of energy functions 
along the solutions of m- 

Definition 3.3. (Noise-dissipative Lyapunov function). A function V £C 2 (R n ;R>„) 
is a noise-dissipative Lyapunov function for EH if there exist W £ C(R ra ;R>„), 
cr £ 1C, and concave r] £ /Coo such that 

(3.3) V(ar) < r,(W(x)), 


for all x £ R n , and the following dissipation inequality holds: 

(3.4) £[V](x,t) < — W(x) + <r(|S(f)|jr), 

for all (x,t) £ R" x [£ 0 ,oo). 

Remark 3.4. (Ito formula and exponential dissipativity). Interestingly, the condi¬ 
tions m and (BUD are equivalent to 

(3.5) C[V](x,t) < -r? _ 1 (V(x)) +cr(|E(£)|^), 

for all x £ R", where 77“ 1 £ /Coo is convex. Note that, since £[V] is not the Lie 
derivative of V (as it contains the Hessian of V), one cannot directly deduce from (13.51) 
the existence of a continuously twice differentiable function V such that 

(3.6) £[V](x,t) < —cV(x) + ct(|E(£)|jt), 

as instead can be done in the context of ISS, see e.g. [l^. • 

Example 3.5. (A noise-dissipative Lyapunov function). Assume that h : R” —> R is 
continuously differentiable and verifies 

(3.7) 7 (||x — x'\\l) < (x — x') T (\7h(x) — S7h(x')) 

for some convex function 7 £ /Coo for all x, x' £ R". In particular, this implies that h 
is strictly convex. (Incidentally, any strongly convex function verifies (13.71) for some 
choice of 7 linear and strictly increasing.) Consider now the dynamics 

(3.8) d x(uj, t) = —(5Lx(cc, t) + Vh(x(u}, t)))dt + £(t) dB(w, t), 
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for all t £ [t 0 , oo), where x(w, t 0 ) = x 0 with probability 1 for some xo £l", and <5 > 0. 
Here, the matrix L £ R raxn is symmetric and positive semidefinite, and the matrix¬ 
valued function E : [io,oo) —t K. raxm is continuous. This dynamics corresponds to the 
SDE (12.11) with /(x, t) = —8Lx — V/i(x) and G(x, t) = l n for all (x, t) £ R n x [to, oo). 

Let x* £ R" be the unique solution of the Karush-Kuhn-Tucker 0 condition 5Lx* = 
—V/i(x*), corresponding to the unconstrained minimization of F(x) = §x T Lx + h(x). 
Consider then the candidate Lyapunov function V £ C 2 (R";R> 0 ) given by V(x) = 
|(x — x*) T (x — x*). Using ( 12 . 21 ) . we obtain that, for all x £ R”, 

£[V](x, t) = —(x — x*) T {^8Lx + V/i(x+ \ trace ^E(£) r E(/)^ 

= -S(x - x*) T L(x - x*) - (x - x*) T (V/i(x) - Vft(x*)) + ±|E(£)| 2 
<- 7 (||x-x*|| 2 ) + i|E(t)| 2 . 

We note that W £ C(R”;R> 0 ) defined by W(x) = 7 (||x — x*|| 2 ) verifies 

V(x) = iy -1 (W(x)) Vx £ R n , 

where y _1 is concave and belongs to the class /Coo as explained in Section [2T2l There¬ 
fore, V is a noise-dissipative Lyapunov function for (13.81) . with concave 77 £ /Coo given 
by r](r) = l/ 27 _ 1 (r) and a £ /C given by cr(r) = 1/2 r 2 . • 

The next result generalizes [J, Th. 4.1] to positive semidefinite Lyapunov functions 
that satisfy weaker dissipativity properties (cf. (13.51) ') than the typical exponential-like 
inequality m, and characterizes the overshoot gain. 

Theorem 3.6. (Noise-dissipative Lyapunov functions have an NSS dynamics). Under 
Assumvtion \2. 1[ and further assuming that E is continuous, suppose thatV is a noise- 
dissipative Lyapunov function for (12.11) . Then, 

(3.9) E[V(x(/))] < p(V(x 0 ),t-t 0 ) +rj(2a( max |E(s)|^)), 

for all t > to, where the class ICC function (r, s) /t(r, s) is well defined as the 

solution y(s) to the initial value problem 

(3.10) y{s) = - 577 _ 1 (?/(s)), j/(0) = r. 


Proof. Recall that Assumption 12.11 guarantees the global existence and uniqueness of 
solutions of m- Given the process {V(x(i))}t>t 0 , the proof strategy is to obtain a 
differential inequality for E[V(x(t))] using Ito formula (12.31) . and then use a compari¬ 
son principle to translate the problem into one of standard input-to-state stability for 
an appropriate choice of the input. 

To carry out this strategy, we consider Ito formula (12.31) with respect to an arbitrary 
reference time instant t' > to, 

(3 ' 11} 

V(x(t)) = V(x(£')) + £[V](x(s), s)ds + VV(x(s)) T G(x(s), s)E(s)dB(s), 
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and we first ensure that the expectation of the integral against Brownian motion is 0. 
Let S k = {x £ R” : ||x|| 2 < k} be the ball of radius k centered at the origin. Fix 
Xq £ R" and denote by r k the first exit time of x(t) from Sk for integer values of k 
greater than ||x(io)|| 2 , namely, r k = inf {s > t 0 : ||x(s)|| 2 > k}, for k > f||a;(to)|| 2 I- 
Since the event {w £ ft : T k < t} belongs to T t for each t > to, it follows that r k is an 
{J-tj-stopping time for each t > to. Now, for each k fixed, if we consider the random 
variable tfc(t) = min{t, Tfc} and define I(t', t ) as the stochastic integral in (Id.Ill) for any 
fixed t' £ [to, tfc(t)], then the process /(£', tfc(t)) has zero expectation as we show next. 
The function X : Sk x [t',t\ —> R given by X(x,s) = VV(x) T G(x, s)S(s) is essen¬ 
tially bounded (in its domain), and thus E[ /*, 1 (s) -Xf(x(s), t) 2 ds] < 00 , where 

l[t',tfeft)]( s ) is the indicator function of the set [t',tk(t)\. Therefore, E[/(t',tfe(t))] = 0 
by 0 , Th. 5.16, p. 26]. Define now V(£) = E[V(x(t))] and W(t) = E[W(x(£))] 
in r(to) = {t > to : V(t) < 00 }. By the above, taking expectations in (Id.Ill) and 
using (USED, we obtain that 


(3.12) 


V(tfc(t))=V(t')+E 

J £[V](x(s),s)ds 

< V(t') - E 

r ftk(t ) 

J W(x(s))ds +E 



cr(|S(s)|^)ds 


for all t £ T(t 0 ) and any t' £ [£ 0 ,£*:(£)]- Next we use the fact that V is continuous 
and {x(£)}t>tn is also continuous with probability 1. In addition, according to Fatou’s 
lemma 1161 p. 123] for convergence in the probability measure, we get that 

(3.13) V(t) =E[V(x(liminf tfe(t)))l = E[ liminfV(x(tfc(t)))] 

L k—>00 J L k —>-oo J 

< liminf E[V(x(tfe(t)))l = liminf V(tfc(t)) 

k—> 00 k—t 00 

for all t £ r(t 0 ). Moreover, using the monotone convergence [lfl p. 176] when k —> 00 
in both Lebesgue integrals in (13.121) (because both integrands are nonnegative and 
l[t',tfc(t)l converges monotonically to 1 as k —> 00 for any t' £ [to, tfc(t)]), we obtain 
from (Id.ldl) that 


(3.14) 


V(t) < V(t') - E / W(x(s))ds 


cr(|E(s)|^)ds 


for all t £ r(t 0 ) and any t' £ [to, t]- Before resuming the argument we make two 
observations. First, applying Tonclli’s theorem [if! p. 212] to the nonnegative process 
{W(x(s))} s > 4 /, it follows that 


(3.15) E[ J W(x(s))ds] = J W(x(s))ds. 

Second, using (13.31) and Jensen’s inequality [2, Ch. 3], we get that 

(3.16) V(t)=E[V(x(t))] <E[r ? (W(x(t)))] < r?(E[W(x(t))]) = 7?(W(t)), 
because r\ is concave, so W (t) > ? 7 _1 (V(t)). Hence, (13.141) and (13.151) yield 


(3.17) 


V(t) <V(t')- / W(s)ds + / a(|£(s)|^)ds 


< 


V(t') + £ ( ^ -T'tVW) + a(|£( S )W) 


ds 
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for all f £ r(tg) and any t' £ [tg, t], which in particular shows that r(t 0 ) can be taken 
equal to [to, oo). 

Now the strategy is to compare V with the unique solution of an ordinary differential 
equation that represents an input-to-state stable (ISS) system. First we leverage 
the integral inequality (13.171) to show that V is continuous in [tg,oo), which allows 
us then to rewrite (13.171) as a differential inequality at t'. To to show that V is 
continuous, we use the dominated convergence theorem [lil . Thm. 2.3, P. 6] applied 
to 14(f) = V(x(t))—V(x(f-t-l/fc)), for t £ [to, f], and similarly taking i—l/k (excluding, 
respectively, the cases when t = f or t = to). The hypotheses are satisfied because 
Vk can be majorized using (13.171) as 

(3.18) lYk(t)\ < y(x(i))-\-V(x(i-\-l/k)) < 2(V(x 0 ) + f <j(|E(s)|jr) ds), 

Jto 

where the term on the right is not a random variable and thus coincides with its 
expectation. Therefore, for every t £ [tg, t], 

limE[V(x(s))] = E[ lim V(x(s))] = E[V(x(t))], 

s—>t s—yt 


so V is continuous on [to, t], for any t > to- Now, using again (13.171) and the continuity 
of the integrand, we can bound the upper right-hand derivative [61, Appendix C.2] (also 
called upper Dini derivative), as 


D + V(t') = 


lim sup 

t-¥t', t>t' 


V(*)-V(Q 

f-f' 


< 


lim sup -- 

t-¥t' ,t>t't — t 



(-V : (V(s))+ cr(|E(s)|^)) ds 


h(V(t'),d(t')), 


for any t' £ [to, oo), where the function h : R>o x K>o —► R is given by 

h(y,d) = ~V~\y) + d, 


and d(t) = cr(|E(t)|_ F ) which is continuous in [to,oo). Therefore, according to the 
comparison principle |6j, Lemma 3.4, P. 102], using that V is continuous in [to,oo) 
and D + \[t') < ti(V(t / ), d(t')), for any if £ [fo,oo), the solutions [H, Sec. C.2] of the 
initial value problem 

(3.19) U(t) = /i(U(t),d(t)), U 0 = U(t 0 ) = V(t 0 ) 

(where h is locally Lipscliitz in the first argument as we show next), satisfy that 
U(t) > V(t) (> 0) in the common interval of existence. We argue the global existence 
and uniqueness of solutions of (13.191) as follows. Since a = rj^ 1 is convex and class 1C oo 
(see Section fOli . it holds that 

a(s') < a(s) < Q:(s , ) + - (s — s') 

for all s £ [s', a"], for any s" > s' > 0. Thus, |a(s) — a(s / )| = a(s) — a(s') < L(s — s'), 
for any s" > s > s' > 0, where L = (a(s") — a(s'))/(s" — s'), so ? 7 -1 is locally 
Lipschitz. Hence, h is locally Lipschitz in M>o x K>o. Therefore, given the input 
function d and any Ug > 0, there is a unique maximal solution of (13.191) . denoted 
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by V(\Jo,t 0 ;t), defined in a maximal interval [f 0 , f ma x(Uo, to)). (As a by-product, the 
initial value problem (13.101) . which can be written as y(s) = ^h(y(s), 0), y(0) = r, 
has a unique and strictly decreasing solution in [0, oo), so p in the statement is well 
defined and in class ICjC.) To show that (13.191) is ISS we follow a similar argument 
as in the proof of j23j, Th. 5] (and note that, as a consequence, we obtain that 
tmax(Uo,fo) = oo). Firstly, if ? 7 _1 (U) > 2d, then U(f) = —^? 7 _1 (U(t)), which implies 
that U is nonincreasing outside the set S = {t > to : U(t) < r/(2d(t))}. Thus, if 
some t* > to belongs to S, then so does every t £ [t*, t ma x(Uo, to)) implying that 
U is locally bounded because d is locally bounded (in fact, continuous). (Note that 
U(f) > 0 because U(t) > 0 whenever U (t) = 0.) Therefore, for all t > to, and for p as 
in the statement (which we have shown is well defined), we have that 

V(i) < U(t) < max |/i(V(to), t — to) , p^2 max d(s) S j j. 

Since the maximum of two quantities is upper bounded by the sum, and using the 
definition of d together with the monotonicity of a, it follows that 

(3.20) V(i) < U(i) < p(V(xo),t-t 0 ) +y(2a( max |E(s)|^')'), 

for all t > t 0 , where we also used that V(f 0 ) = V(a;o), and the proof is complete. □ 

Of particular interest to us is the case when the function V is lower and upper bounded 
by class K .<*> functions of the distance to a closed, not necessarily bounded, set. 

Definition 3.7. (NSS-Lyapunov functions). A function V £ C 2 (R”; R> 0 ) is a strong 
NSS-Lyapunov function in probability with respect to U C R™ for (12.11) if V is a 
noise-dissipative Lyapunov function and, in addition, there exist p > 0 and class K. ^ 
functions a\ and c *2 such that 

(3.21) ai(\x\ff) < V(x) < a 2 (|x|^), Vx £ R". 

If, moreover, ol\ is convex, then V is a pth moment NSS-Lyapunov function with 
respect to U. 

Note that a strong NSS-Lyapunov function in probability with respect to a set satisfies 
an inequality of the type (13.211) for any p > 0, whereas the choice of p is relevant 
when ot\ is required to be convex. The reason for the ‘strong’ terminology is that 
we require (13.51) to be satisfied with convex rj~ 1 £ /Coo. Instead, a standard NSS- 
Lyapunov function in probability satisfies the same inequality with a class /Coo function 
which is not necessarily convex. We also note that (13.211) imnlies that U = {x £ R n : 
V(x) = 0}, which is closed because V is continuous. 

Example 3.8. fExample 13.51 -revisited: an NSS-Lyapunov function). Consider the 
function V introduced in Example 13.51 For each p £ (0,2], note that 

aip(||a: - x*\\^) < V(x) < a 2p (\\x - x*\\^) Mx £ R”, 

for the convex functions aq p (r) = a 2p (r) = r 2 / p , which are in the class /Coo- (Recall 
that a 2 in Definition IQ is only required to be /Coo-) Thus, the function V is a pth 
moment NSS-Lyapunov function for (13.81) with respect to x* for p £ (0, 2]. • 
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The notion of NSS-Lyapunov function plays a key role in establishing our main result 
on the stability of SDEs with persistent noise. 

Corollary 3.9. (The existence of an NSS-Lyapunov function implies the corre¬ 
sponding NSS property). Under Assumption and further assuming that E is 
continuous, given a closed set Id C R n , 

(i) if V £ C 2 (R";R> 0 ) is a strong NSS-Lyapunov function in probability with 
respect to U for m, then the system is NSS in probability with respect to Id 
with gain functions 

(3.22) p(r,s) =af 1 {\fi{a 2 {r p ),s)), 9{r) = ay 1 (f p(2o-(r))); 

(ii) ifY £ C 2 (R";R> 0 ) is a pthNSS-Lyapunov function with respect told for m, 
then the system is pth moment NSS with respect to Id with gain functions p 
and 6 as in (|3.22[) setting e = 1. 

Proof. To show (i), note that, since a\{\x\ p ) < V(x) for all i€l", with a\ £ /Coo, it 
follows that for any p > 0 and t > to, 

PjkWIS > p} = P{ai(|x(t)|2) > ai(/5)| < p{v(x(i)) > ou(p)} < 

(3.23) < 2(^0 1£), t - t 0 ) + ^(M t ™^J E ( s )W)) ’ 

where we have used the strict monotonicity of a± in the first equation, Chebyshev’s 
inequality [2, Ch. 3] in the second inequality, and the upper bound for E[V(x(i))] 
obtained in Theorem 13.61 cf. (13.91) . in the last inequality (leveraging the monotonicity 
of fi in the first argument and the fact that V(x) < ot 2 {\x\u) for all x £ R”). Also, for 
any function a £ 1C, we have that a(2r) + a(2s) > a(r + s) for all r, s > 0. Thus, 

(3.24) p(e,x 0 ,t) = p(\x 0 \ u ,t - t 0 ) + o( max |E(s)|j2) 

\ t 0 <S<t / 



Substituting now p = /5(e) in (13.231) . and using that p(e,Xo,t) > /5(e), we get that 
P{|z(i)|u > P(e,x 0 ,t)} < P{|x(i)|£ > /3(e)} < e. 

To show (ii), since af 1 is concave, applying Jensen’s inequality [J, Ch. 3], we get 

E[\x(t)\ p ] < E[oq ^V^i)))] < Q! r 1 (E[V(x(/))]^ < p( 1) < p(l,x 0 ,t), 

where in the last two inequalities we have used the bound for E[V(x(/))] in (13.231) 
and the definition of /5(e) in ()3.24l) . □ 

Example 3.10. ^Example 13.51 revisited: illustration of Corollary 13.91) . Consider 
again Example 13.51 Since V is a pth moment NSS-Lyapunov function for (13.81) with 
respect to the point x* for p £ (0, 2], as shown in Example 13.81 Corollary 13.91 implies 
that 

(3.25) E[||x- x*||£] < p(\\x 0 - x*|| 2 ,t-to) + &( max |E(s)|jr), 
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Evolution of the coordinates 


Evolution of the second moment 




time, t 

(b) 


Fig. 3.1: Evolution of the dynamics (13.81) with L = 0, h(x 1 , 22 ) = log (e ^ 1 2 ) + 
e( a; 2 +i)^ +0.5(* 1 +a : 2 —1)2 +(si — 0 : 2 ) 2 , and initial condition [xi(0), 2 : 2 ( 0 )] = (1, —0.5). 
Since h is a sum of convex functions, and the Hessian of the quadratic part of h has 
eigenvalues {2,4}, we can take 7 given by j(r) = 2r, for r > 0. Plot (a) shows the 
evolution of the first and second coordinates with £ = 0.1 12 . Plot (b) illustrates the 
noise-to-state stability property in second moment with respect to x* = (0.36,0.14), 
where the matrix £(i) is a constant multiple of the identity. (The expectation is 
computed averaging over 500 realizations of the noise.) 


for all t > t 0 , Xq € R n , and p e ( 0 , 2 ], where 

p{r,s) = (2 p{r 2 ,s)) p/2 , 0(r) =(7 _1 (r 2 )) P/2 , 

and the class ICC function p is defined as the solution to the initial value prob¬ 
lem (13.101) with r](r) = 57 _ 1 (r). Figure l3Jl illustrates this noise-to-state stability 
property. We note that if the function h is strongly convex, i.e., if j(r) = c^r for 
some constant c 7 > 0 , then p : R > 0 x R>o —> R>o becomes p(r,s) = re _c t s , and 
p(r, s) = 2^/2 r p e~ c 'i p l 2s , so the bound for E[||x — x*!^] in (13.251) decays exponentially 
with time to 0 (ma xt 0 < s <t |S(s)|jr). • 

4. Refinements of the notion of proper functions. In this section, we an¬ 
alyze in detail the inequalities between functions that appear in the definition of 
noise-dissipative Lyapunov function, strong NSS-Lyapunov function in probability, 
and pth moment NSS-Lyapunov function. In Section 14.11 we establish that these in¬ 
equalities can be regarded as equivalence relations. In Section B~21 we make a complete 
characterization of the properties of two functions related by these equivalence rela¬ 
tions. Finally, in Section l4~3l these results lead us to obtain an alternative formulation 
of Corollary 13.91 


4.1. Proper functions and equivalence relations. Here, we provide a refine¬ 
ment of the notion of proper functions with respect to each other. Proper functions 
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play an important role in stability analysis, see e.g., ESI 

Definition 4.1. (Refinements of the notion of proper functions with respect to each 
other). Let V C R" and the functions V, W : T> — > R>o be such that 

ai(W(x)) < V(x) < tt2(W(a:)), Vx £ V, 

for some functions a±, a .2 : R>o R>o- Then, 

(i) if ai,a 2 £ 1C, we say that V is 1C -dominated by W in V, and write 

V W in V; 

(ii) if ai, a .2 £ 1C 00 , we say that V and W are /Coo - proper with respect to each 
other in T>, and write V W in V; 

(Hi) if 01,02 £ ACoo are convex and concave, respectively, we say that V and W 
are AC^ - (convex-concave) proper with respect to each other in T>, and write 

V W in V; 

(iv) if a 1 (r) = c ai r and a 2 (r) = c a2 r, for some constants c ai ,c a2 > 0, we say 
that V and W are equivalent in T>, and write V ~ W in T>. 

Note that the relations in Definition 14.11 are nested, i.e., given V, W : T> — > R>o, the 
following chain of implications hold in T>: 

(4.1) V ~ W => V W => V W => V <f W. 

Also, note that if W(x) = ||x|| 2 , T> is a neighborhood of 0, and a\,a 2 are class 1C, then 
we recover the notion of V being a proper function [f|. If V = R", and V and W are 
seminorms, then the relation ~ corresponds to the concept of equivalent seminorms. 

The relation ~' c °° is relevant for ISS and NSS in probability, whereas the relation ~ K “ 
is important for pth moment NSS. The latter is because the inequalities in are 
still valid, thanks to Jensen inequality, if we substitute V and W by their expectations 
along a stochastic process. Another fact about the relation is that or, 02 £ /Coo, 
convex and concave, respectively, must be asymptotically linear if V(T>) A [s 0 ,oo), 
for some so > 0, so that «i(s) < ot 2 (s) for all s > Sq■ This follows from Lemma TA.II 

Remark 4.2. (Quadratic forms in a constrained domain). It is sometimes convenient 
to view the functions V, W : T> —> R>o as defined in a domain where their functional 
expression becomes simpler. To make this idea precise, assume there exist i : T> C 
1" —► R m , with m > n, and V, W :!?—>■ R>o, where V = i(D), such that V = V o i 
and W = W o i. If this is the case, then the existence of a\, 02 : K>o —> R>o such 
that «i(W(i)) < V(x) < a 2 (W(x)), for all x £ V, implies that «i(W(x)) < V(x) < 
« 2 (W(x)), for all x £ T>. The reason is that for any x £ T> there exists x £ T>, given 
by x = i(x), such that V(x) = V(x) and W(x) = W(x), so 

«i(W(x)) = ai(W(x)) < V(x) = V(x) < a2(W(x)) = a2(W(x)). 

Consequently, if any of the relations given in Definition 14.11 is satisfied by V, W 
in V, then the corresponding relation is satisfied by V, W in V. For instance, in 
some scenarios this procedure can allow us to rewrite the original functions V, W as 
quadratic forms V, W in a constrained set of an extended Euclidean space, where it 
is easier to establish the appropriate relation between the functions. We make use of 
this observation in Section 14.31 below. • 

Lemma 4.3. (Powers of seminorms with the same nullspace). Let A and B in R mXTl 
be nonzero matrices with the same nullspace, JC(A) = Then, for any p, q > 0, 


14 




the inequalities aq(||x||^) < ||x||g < « 2 (ll^ll^) are verified with 


, ^ A fXn-k(B T B)^i alv 

a,W = (w^A)) T • 



A max {B T B)\i 
\ n -k(A T A)) 


r q / p , 


where k = dim(Af(A)). In particular , ||.||^ ~ ||.||^ and ||.||^ ||.||g in R” for 

any real numbers p,q > 0. 

Proof. For U = J\T{A), write any x £ l ra as x = x u + x u ±, where x u £ U and 
x u ± £ {x £ R n : x T u = 0 ,Vu £ U}, so that Ax = A(x u + x u ±) = Ax u ±- and 
Bx = Bx u ± because Af(A) = A f{B) = U. Using the formulas for the eigenvalues in [Hi, 
p. 178], we see that the next chain of inequalities hold: 

“iOMIa) = oa(jxu±A T Ax u ±) 2 ) <ai((A ma X (A T A)xf l xx u ^) 2 ^j 

< (A n-k{B T B)x^x U A.y < [x^B T Bx U A.y < ( X max (B T B)x^x u ±) 5 

< a 2 [{X n - k {A T A)xf A A.x u Bj^ < a 2 ((xf l ±A T Ax u ±)^ = a 2 (||x||^), 

where ||x||^ = (xf /± B T Bx u ±) 2 . From this we conclude that ||.||^ ~ Ko ° ||.||g in R”. 
Finally, when p = q : the class /Coo functions oq, oa in the statement are linear, so we 
obtain that ||.||^ ~ ||.||g in R". 0 

Next we show that ~ K “ and ~ K “ are reflexive, symmetric, and transitive, and hence 
define equivalence relations. 

Lemma 4.4. (The /Coo- and AC“-proper relations are equivalence relations). The 
relations ~ K °° and in any set V C R™ are both equivalence relations. 

Proof. For convenience, we represent both relations by ~*. Both are reflexive, i.e., 

V ~* V, because one can take ai(r) = a 2 (r) = r noting that a linear function is 
both convex and concave. Both are symmetric, i.e., V ~* W if and only if W V, 
because if cm o W < V < o W in 2?, then af 1 o V < W < af 1 o V in V. In 
the case of ~ K “, the inverse of a class /Coo function is class ACoo ■ Additionally, in the 
case of ~ K “, if a £ /Coo is convex (respectively, concave), then a -1 £ /Coo is concave 
(respectively, convex). Finally, both are transitive, i.e., U ~* V and V W imply 
U W, because if a± o V < U < a 2 ° V and a\ o W < V < a 2 ° W in V, then 
a.\ o a\ o W < U < «2 o d 2 o W in V. In the case of ~ K “, the composition of two 
class ACoo functions is class ACoo • Additionally, in the case of ~ K “, if oq, a 2 £ ACoo are 
both convex (respectively, concave), then the compositions oq o «2 and a 2 °«i belong 
to ACoo and are convex (respectively, concave), as explained in Section [2.21 □ 

Remark 4.5. (The relation <d K is not an equivalence relation). The proof above also 
shows that the relation <| K is reflexive and transitive. However, it is not symmetric: 
consider V,W £ C(R";R> 0 ) given by V(x) = 1 — e~^ 2 and W(x) = ||a;|| 2 - Clearly, 

V <] K W in R ra by taking cti = 0:2 = a £ AC, with a(s) = 1 — e~ s . On the other 

hand, if there exist di,d 2 £ AC such that aq(V(:r)) < W(a:) < 0:2 (V(x)) for all 
x £ R", then we reach the contradiction, by continuity of a 2 , that lim|| a .|| 2 _ >0O ||x ||2 < 
0 : 2 (lim||x|| 2 ^oo (l - e -||x|12 )) = d 2 (l) < 00 . • 


4.2. Characterization of proper functions with respect to each other. 

In this section, we provide a complete characterization of the properties that two 
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functions must satisfy to be related by the equivalence relations defined in Section fd.il 
For T> C R”, consider Vi, V 2 : T> —> R> 0 . Given a real number p > 0, define 


fa(s) ~ SU P Vi (y), 
{yev : V 2 (j/) < fys} 


fa(s) = inf Vi{y), 

{y£T> :V 2 (y) > tys} 


for s > 0. The value fa(s) gives the supremum of the function Vi in the fas - sublevel 
set of V 2 , and fa(s) is the infimum of Vi in the fas - superlevel set of V 2 . Thus, the 
functions fa and fa satisfy 

(4.2) fa(V 2 (x) p ) = inf Vi(y) < Vi(x) < sup Vi(y) = q 6 p (V 2 (x) p ), 

{2/6D: {y&v- 

v 2 (y) > v 2 (x)} v 2 (y)<v 2 (x)} 

for all x £ V, which suggests fa and ip p as pre-comparison functions to construct on 
and a 2 in Definition im To this end, we find it useful to formulate the following 
properties of the function Vi with respect to V 2 : 

PO: The set {x £ T> : V 2 (x) = s} is nonempty for all s > 0. 

PI: The nullsets of Vi and V 2 are the same, i.e., {x £ V : Vi(x) = 0} = {x £ V : 
V 2 (x) = 0}. 

P2: The function fa is locally bounded in R>o and right continuous at 0, and fa is 
positive definite. 

P3: The next limit holds: lim^oo fa (s) = 00 . 

P4 (as a function of p > 0): The asymptotic behavior of fa and fa is such that fa(s) 
and s 2 /ip P (s) are both in O(s) as s —> 00 . 

The next result shows that these properties completely characterize whether the func¬ 
tions Vi and V 2 are related through the equivalence relations defined in Section 1X11 
This result generalizes Lemma 4.3] in several ways: the notions of proper functions 
considered here are more general and are not necessarily restricted to a relationship 
between an arbitrary function and the distance to a compact set. 

Theorem 4.6. (Characterizations of proper functions with respect to each other). 
Let Vi, V 2 : L> —> M>o, and assume V 2 satisfies P0. Then 

(i) Vi satisfies {P*}? =1 with respect to W 2 Vi W 2 in T>; 

(ii) Vi satisfies {P*}? =1 with respect to W 2 Vi ~ K °° V 2 in V; 

(Hi) Vi satisfies {Pi}| =1 with respect to \ 2 for p > 0 <t=> Vi Vj in V. 

Proof. We begin by establishing a few basic facts about the pre-comparison functions 
ip p and fa. By definition and by P0, it follows that 0 < fa (s) < fa(s) for all s > 0. 
Since fa is locally bounded by P2, then so is fa. In particular, fa and fa are well 
defined in R>o- Moreover, both fa and fa are nondecreasing because if S 2 > si, then 
the supremum is taken in a larger set, {x £ V : Y 2 {x) < S 2 } 2 {x £ V : V 2 (x) < Si}, 
and the infimum is taken in a smaller set, {x £ T> : V 2 {x) > S 2 } C {x £ T> : 
V 2 (x) > si}. Furthermore, for any q > 0, the functions fa and ip q are also monotonic 
and positive definite because fa(s) = fa (fas) and ip q (s) = fa(fas) for all s > 0. 
We now use these properties of the pre-comparison functions to construct cci, 0:2 in 
Definition 14.11 required by the implications from left to right in each statement. 
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Proof of (i) (=>)■ To show the existence of a 2 £ K such that a 2 (s) > fa{s) for all 
s £ K>o, we proceed as follows. Since fa is locally bounded and nondecreasing, given 
a strictly increasing sequence {bk}k> 1 Q R>o with lim /-_>. 00 bk = oo, we choose the 
sequence {Mk}k> 1 Q R>o, setting M 0 = 0 , in the following way: 

(4.3) Mk = max( sup fa(s ), M k -i + 1/fc 2 ) = max{fa(b k ), M fe _i + 1/k 2 }. 
L se[o,fe fc ] J 

This choice guarantees that {Mk}k>i is strictly increasing and, for each k > 1 , 



(4.4) 


Also, since fa is right continuous at 0, we can choose b\ > 0 such that there exists 
0-2 '■ [ 0 , bi] —> R>o continuous, positive definite and strictly increasing, satisfying that 
a 2 (s) > fa (s) for all s £ [0, 6 i] and with a 2 ( 6 i) = M 2 . (This is possible because the 
only function that cannot be upper bounded by an arbitrary continuous function in 
some arbitrarily small interval [0, 61 ] is the function that has a jump at 0.) The rest 
of the construction is explicit. We define a 2 as a piecewise linear function in ( 61 , 00 ) 
in the following way: for each k > 2 , we define 


Mk+\ — a 2 (6fc_i) , . 

-----(s - b k - 1 ), 


a 2 (s) = a 2 (b k -i) + 


Vs e (&fc— 1 , fefc]- 


The resulting a 2 is continuous by construction. Also, a 2 (&i) = M 2 , so that, induc¬ 
tively, a 2 (bk- 1 ) = Mk for k > 2. Two facts now follow: first, Mk+\ — a 2 {bk- 1 ) = 
Mk +1 — Mk > 1 /{k + 1) 2 for k > 2 , so <x 2 has positive slope in each interval (bk-i,bk\ 
and thus is strictly increasing in ( 61 , 00 ); second, a 2 (s) > a 2 (bk-i) = Mk > fa(bk) > 
fa (s) for all s G ( 6 fc_i, 6 fc], for each k > 2 , so a 2 (s) > fa (s) for all s € ( 61 , 00 ). 

We have left to show the existence of oq £ /C such that aii(s) < V , i( s ) f° r all s £ R>o- 
First, since 0 < fa(s) < fa (s) for all s > 0 by definition and by P0, using the 
sandwich theorem 11, p. 107], we derive that fa is right continuous at 0 the same 
as fa. In addition, since fa is nondecreasing, it can only have a countable number of 
jump discontinuities (none of them at 0). Therefore, we can pick ci > 0 such that a 
continuous and nondecreasing function fa can be constructed in [ 0 , Ci) by removing 
the jumps of fa, so that fa(s) < fa(s). Moreover, since fa is positive definite and 
right continuous at 0, then fa is also positive definite. Thus, there exists a\ in [0, Ci) 
continuous, positive definite, and strictly increasing, such that, for some r < 1 , 

(4.5) ai(s) < rfa(s) < rfa{s ) 

for all s £ [0,Ci). To extend oq to a function in class K. in R>o, we follow a sim¬ 
ilar strategy as for a 2 ■ Given a strictly increasing sequence {ck}k >2 Q ®>o with 
limfc^oo Cfc = 00 , we define a sequence {mfc}fe>i C ]R > 0 in the following way: 



Next we define u\ in [ci, 00 ) as the piecewise linear function 



Vs £ \ck, Ck- pi), 


Cfc +1 — Ck 
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for all k > 1, so a.\ is continuous by construction. It is also strictly increasing because 
ai(c 2 ) = mi = (V’i(ci) + ai(ci))/2 > ai(ci) by (14.51) . and also, for each k > 2, 
the slopes are positive because m k — oti(c k ) = m*, — mk-i > 0 (due to the fact 
that {mk}k >l in (14.61) is strictly increasing because ^ is nondecreasing). Finally, 
«i(s) < ai(cfe+i) = TO fe < V’i(cfe) < 0i(s) for all s <E [c fe ,c fc+ i), for all k > 1 by fl4~6l) . 

Equipped with on, a 2 as defined above, and as a consequence of m, we have that 

(4.7) ai(V 2 (x)) < ip 1 (V 2 (x)) < Vi(x) < </> 1 (V 2 (x)) < a 2 (V 2 (x)), Vx G T>. 

This concludes the proof of (i) (=>-). 

As a preparation for (ii)-(iii) (=4-), and assuming P3, we derive two facts regarding 
the functions a\ and a 2 constructed above. First, we establish that 

(4.8) a 2 (s) £ 0(</>i(s)) as s —> oo. 

To show this, we argue that 

(4.9) lim sup (a 2 (s) - <£i(s)) < lirn (^( 6 ^+ 1 ) - </> 1 ( 6 fc „i)) + 7 r 2 / 6 , 

k ^°° se(6 fc _i,6 fc ] 


so that there exist C,s 1 >0 such that a 2 (s) < 30i(s) + C”, for all s > si. Thus, 
noting that lim^oo 4>i (s) = 00 as a consequence of P3, the expression (14.81) follows. 
To establish (14. 91) . we use the monotonicity of a 2 and 0i, (14.31) and (14.41) . For k > 2, 

sup (a 2 (s) - </>i(s)) < a 2 (b k ) - (j>i{b k -i) = M k+ 1 - <j>i{b k -i) 
se(bfc- i,bk] 

= max {<j) 1 (b k+1 ) - </>i( 6 fc_i), M k + 1 /{k + l ) 2 - 0i(& fc _i)} 

< max{ 0 1 ( 6 fc+ i) - 4h(bk- 1 ) > 4>i{bk) + tt 2 / 6 + l/(k + l ) 2 - ^i(b k -i)}- 

Second, the construction of a.\ guarantees that 

(4.10) ^i(s) £ 0(ai(s)) as s —> 00 , 
because, as we show next, 

(4.11) lim sup (ipi(s) - ai(s)) < lim (ai(c k+2 ) - au(c fc )), 

fc-soo se [c kt c k+1 ) k^oo 

so there exists s 2 > 0 such that < 3ai(s) for all s > s 2 . To obtain (14.111) . we 
leverage the monotonicity of ip 1 and a±, and (14.61) : namely, for k > 2, 

sup (ipi{s) - «i(s)) < ipi{ck+ 1 ) - ou(cfc) 

s6[cfe,Cfc+i) 

= m k+ 1 + - ai (cfc) = ai(c fc+2 ) + ^i+lk+l)^ - ai(c fc ). 

Equipped with (14.81) and (|4.10l) . we prove next (ii)-(iii) (=>). 

Proof of (ii) (=>): If, in addition, P3 holds, then lirn^oo 4>i(s) > lim^oo 0i(s) = 00 . 
This guarantees that a 2 £ 1C oo. Also, according to (14.101) . P3 implies that ct\ is 
unbounded, and thus in 1C^ as well. The result now follows by m - 
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Proof of (in) (=>): Finally, assume that P4 also holds for some p > 0. We show 
next the existence of the required convex and concave functions involved in the rela¬ 
tion ~ K “. Let aq iP (s) = &\(fas) and oq lP (s) = ot 2 {fas) for s > 0, so that 

a 1 )P (s) = ai({/s) < fa{fas) = fa{s) and fa(s) = fa(fas) < = c* 2 ,p(s). 

From (14.811 and P4, it follows that there exist s', Ci, C 2 > 0 such that oi 2 (s) < ci^i(s) 
and fa(s) < C 2 S for all s > s'. Thus, 

oc2, P (s) = a 2 (fas) < dfa(faS) = afa{s) < dc 2 s, 

for all s > s', so aq lP (s) is in 0(s) as s —> oo. Similarly, according to (14.101) and P4, 
there are constants s", C 3 , C 4 > 0 such that fa(s) < C 3 «i(s) and s 2 < C 4 Sip P {s) for 
all s > s". Thus, 

sai iP (s) = sqi(^) > = s ±fa(s) > -^s 2 , 

for all s > s", so s 2 /aq jP (,s) is in O(s) as s —> 00 . Summarizing, the construction of 
au, a .2 guarantees, under P4, that aq jP , aq.p satisfy that s 2 /aq iP (s) and 0 : 2 , P (s) are 
in O(s) as s —> 00 (and, as a consequence, so are s 2 /a2,p(s) and aq :P (s)). Therefore, 
according to Lemma |A. 11 we can leverage m by taking aq, a 2 € /Coo, convex and 
concave, respectively, such that, for all x € V, 

Si (V 2 (a;) p ) < ai,p(V 2 (^) p ) = oq(V 2 (x)) < fa(V 2 {x)) < Vi(x) 

<</>i(V 2 (x)) < a 2 (V 2 (x)) — a 2 ,p(V 2 (x) p ) < d 2 (V 2 (x) p ). 

Proof of (i) (-4=): If there exist class /C functions oq, a 2 such that aq(V 2 (x)) < 
Vi(x) < oq (V 2 (x)) for all x € T>, then the nullsets of Vi and V 2 are the same, which 
is the property PI. In addition, 0 < fa(s) < a 2 (s) for all s > 0, so fa is locally 
bounded and, moreover, the sandwich theorem guarantees that fa is right continuous 
at 0. Also, since aq(s) < fa(s), for all s > 0, and ^q(O) = 0, it follows that fa is 
positive definite. Therefore, P2 also holds. 

Proof of (it) (<=): Since fa(s) > aq(s) for all s > 0, the property P3 follows because 

lim fa(s) > lim ai(s) = 00 . 

s—>-00 S—t OO 


Proof of (in) fa=)’. If Vi Vf, then Vi Vf by (14.IF Also, we have trivially 
that Vf ~ x '°° V 2 • Since is an equivalence relation by Lemma f4.41 it follows that 
Vr V 2 , so the properties {Pi}f =1 hold as in (ii) (<=). We have left to derive P4. 
If Vi Vj, then there exist £* 1 , 0:2 £ /Coo convex and concave, respectively, such 
that Oi(V 2 (x) p ) < Vi(x) < a 2 (V 2 (x) p ) for all x G T>. Hence, by the definition of fa 
and fa, and P0, and by the monotonicity of aq and 02, we have that, for all s > 0, 


oq(s) < inf aq(V 2 (x) p ) < inf Vi(x)=V’ P (s) 

{ICC: V 2 (x)P>s} V ’ {i 6C:V 2 (i)!>>s} 

(4.12) < fa(s) = sup Vi(x) < sup a 2 (V 2 (x) p ) < a 2 (s). 

: V 2 (x)p<s} {x£T >: V2(a?) p <s} 


Now, since 01,02 G /Coo are convex and concave, respectively, it follows by Lemma fA.il 
that s 2 /aq(s) and 02 (s) are in 0(s ) as s —> 00 . Knowing from (14.121) that oi(s) < 
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tp p (s) < c/> p (s) < a 2 (s ) for all s > 0 , we conclude that the functions s 2 /'i/j p (s) and (f p (s) 
are also in 0(s) as s —> oo, which is the property P4. □ 

The following example shows ways in which the conditions of Theorem 14.61 might fail. 

Example 4.7. (Illustration of Theorem 14.61) . Let V 2 : R 2 —>■ R > 0 be the distance to 
the set {(^ 1 ,^ 2 ) £ R 2 : X\ = 0}, i.e., V 2 (xi,x 2 ) = \xi\. Consider the following cases: 

P2 fails (y\ is not positive definite): Let Vi(xi,X 2 ) = \xi\e^^ X2 ' for (xi,X 2 ) £ R 2 . 
Note that Vi is not /C- dominated by V 2 because, given any a\ £ 1C, for every X\ £ R 
with \xi\ > 0 there exists x 2 £ R such that the inequality ai(|xi|) < \x\\e~' X2 ' does 
not hold (just choose x 2 satisfying \x 2 \ > log Thus, there must be some of 

the hypotheses on Theorem 14.61 that fail to be true. In this case, we observe that 


V’i(s) 


inf Ixile 

I(ii,l2)6* 2 : \x\\ >s} 


is identically 0 for all s > 0, so it is not positive definite as required in P2. 

P2 fails ("</>! is not locally bounded): Let Vi(xi,X 2 ) = |xi|el X2 l for (x\,x 2 ) £ R 2 . As 
above, one can show that a 2 does not exist in the required class; in this case, the 
hypothesis P2 is not satisfied because is not locally bounded in (0,oo): 

= sup |*i|el X2 l = 00 , V s > 0. 

{(®1j® 2)€M 2 : |^i| <s} 


P2 fails ((j> 1 is not right continuous): Let Vi(xi, x 2 ) = |a:i| 4 +| sin(xiX 2 )| for (xi,X 2 ) £ 
R 2 . For every p > 0, we have that 

4> p (s) = sup |xi | 4 + | sin (xix 2 )| < s 4//p + 1 , 

{(®i,x 2 )eR 2 : |a;i| p <s} 


so f> p is locally bounded in R>o, and, again for every p > 0 , 


ip P {s) = inf 

{(xi,x 2 )eR 2 :|*i| p >s} 


|xi | 4 + | sin (xix 2 )| > s 4/p , 


so ip p is positive definite. However, <f) p is not right continuous at 0 because sin (X 1 X 2 ) = 
0 when xi = 0 , but sup {(a . 1>a . 2)eR 2 . | Xl | P < So} sin (xix 2 ) = 1 for any s 0 > 0 , so by 
Theorem 14.61 (i), it follows that Vi is not /C-dominated by V 2 . 

Pf fails (non-compliant asymptotic behavior): Let Vi(xi,X 2 ) = |xi | 4 for (xi,X 2 ) £ 
R 2 . Then P2 is satisfied and P3 also holds because lims^oo i/j 1 (s) = limg^oo s 4 = 00 , 
so Theorem l4.6l (ii) implies that Vi and V 2 are /Coo-proper with respect to each other. 
However, in this case <j> p {s ) = ^ p (s) = s 4 / p , which implies that 4> p is not in O(s) as 
s —> 00 when p £ (0,4), and s 2 /ip P (s) is not in 0(s ) as s —> 00 when p > 4. Thus P4 
is satisfied only for p = 4, so Theorem 14.61 (in) implies that only in this case Vi and 
V p are Kfff- proper with respect to each other. Namely, for p > 4, one cannot choose 
a convex a\ £ /Coo such that ai(|xi| p ) < |xi | 4 for all xi £ R and, if p < 4, one cannot 
choose a concave a 2 £ /Coo such that |xi | 4 < a 2 (|xi] p ) for all X\ £ R. • 


4.3. Application to noise-to-state stability. In this section we use the results 
of Sections 14.11 and 14.21 to study the noise-to-state stability properties of stochastic 
differential equations of the form m • Our first result provides a way to check 
whether a candidate function that satisfies a dissipation inequality of the type m 
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is in fact a noise-dissipative Lyapunov function, a strong NSS-Lyapunov function in 
probability, or a pth moment NSS-Lyapunov function. 

Corollary 4.8. (Establishing proper relations between pairs of functions through 
seminorms). Consider Vi,V 2 : T> —> M>o such that their nullset is a subspace U. 
Let 4,1 £ M mxn £/j a £ AT (A) =IA = Af(A). Assume that Vi and V 2 satisfy 

{Pi}f =0 with respect to ||.||^4 and ||.||^ ; respectively. Then, for any q > 0, 

V 1 ~ k “V 2 , Vi~ k “||.||^, V 2 ~ k -||.||^ m V. 

If, in addition, Vi and V 2 satisfy P4 with respect to ||.||a and ||.||^, respectively, for 
some p > 0, then 

Vl V 2 , Vi II-IIa, V 2 ||.||L zn V. 


Proof. The statements follow from the characterizations in Theorem l4.6l (ii) and (Hi), 
and from the fact that the relations ~ K °° and are equivalence relations as shown 
in Lemma 031 That is, under the hypothesis P0, 

Vi satisfies {Pi }? =1 w/ respect to ||.||a (<^> Vi ||.||a in v ) \ . v t v • ^ 
V 2 satisfies {Pi}f =1 w/ respect to (<£>• V 2 jj.jj^ in V) J 1 ~ 2 ’ 

Vi satisfies {Pi}f = i w/ respect to ||.||a (<* Vi IUIa in V)\ 

V 2 satisfies {Pi}f =1 w/ respect to (44- V 2 in V) j 1 ~ 2 

Note that, by Lemma FP1 and (|4.1[) . the equivalences 

IUU~ K ~||.||^ mV, 11.1^^11.11^ in V 

hold for any p,q > 0 and any matrices A, A € R mxn with Af(A) = Af (A). □ 

We next build on this result to provide an alternative formulation of Corollary 13.91 
To do so, we employ the observation made in Remark 14.21 about the possibility of 
interpreting the candidate functions as defined on a constrained domain of an extended 
Euclidean space. 

Corollary 4.9. (The existence of a pthNSS-Lyapunov function implies pth moment 
NSS -revisited). Under As sumption \2fl 1 let V £ C 2 (R";R> 0 ), W € C(R ra ;R> 0 ) and 
<j £ 1C be such that the dissipation inequality dSH) holds. Let R : R n R( m " n \ 
with m > n, D C R m , V £ C 2 ((Z?;R> 0 ) and W £ C(2?;R> 0 ) be such that, for i(x) = 
[x T ,R{x) T ] T , one has 

V = i(R n ), V = Voi, and W = Wo i. 

Let A = diag(Ai, A 2 ) and A = diag(Ai, A 2 ) be block-diagonal matrices, with A±, A\ £ 
R” x " and A 2 ,A 2 £ such thatAf(A) =Af{A) and 

(4-13) ||i?(x)||i 2 < kII^Haj 

for some k > 0, for all x £ R ra . Assume that V and W satisfy the properties {Pz}f _ 0 
with respect to ||.||a and ||.||^, respectively, for some p > 0. Then the system (12.11) is 
NSS in probability and in pth moment with respect to Af(Ai). 
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Proof. By Corollary 14.81 we have that 

(4.14) V-^W, and V IMIL^, Aa) in V. 

As explained in Remark 14.21 the first relation implies that V W in R ra . This, 
together with the fact that (13.41) holds, implies that V is a noise-dissipative Lyapunov 
function for (EH). Also, setting x = i(x) and using (14.131) . we obtain that 

\\A\m < ll'^lldiag(A 1 , A?) = IMI^ + \\ R ( x )\\a 2 < A + *)IMI 

so, in particular, ||[.,ii(.)]||j iag ^ i a 2 ) ~ II-IIai i n Now, from the second relation 
in (14.141) . by Remark l4~2l it follows that Vo i ||[., |ld ia g(^4i a 2 ) * n Thus, 

using GH and Lemma [4.41 we conclude that V ||.||^ in R". In addition, the 
Euclidean distance to the set Af(Ai) is equivalent to ||.||ai, be., |.|jy (Al) ~ ||-||ai- This 
can be justified as follows: choose B £ R nxfc , with k = dim(A r (A 1 )), such that the 
columns of B form an orthonormal basis of Af(Ai). Then, 

(4.15) Mjvoao = 11(1 — BB t ) x \\2 = ||a:||i _ bb t ~ II-IUd 

where the last relation follows from Lemma PTTTTI because Af(l— BB T ) = M{A\). Sum¬ 
marizing, V II*IIAj an< 4 II-IIai ~ i n (because the pth power is irrelevant 

for the relation ~). As a consequence, 

(4.16) V^MV) in 

which implies condition (13.211) with convex a\ £ /Coo, concave 02 £ /Coo, and U = 
Af(Ai). Therefore, V is a pth moment NSS-Lyapunov function with respect to the 
set J\f(Ai), and the result follows from Corollary 13.91 □ 

5. Conclusions. We have studied the stability properties of SDEs subject to 
persistent noise (including the case of additive noise). We have generalized the concept 
of noise-dissipative Lyapunov function and introduced the concepts of strong NSS- 
Lyapunov function in probability and pth moment NSS-Lyapunov function, both with 
respect to a closed set. We have shown that noise-dissipative Lyapunov functions have 
NSS dynamics and established that the existence of an NSS-Lyapunov function, of 
either type, with respect to a closed set, implies the corresponding NSS property of 
the system with respect to the set. In particular, pth moment NSS with respect to 
a set provides a bound, at each time, for the pth power of the distance from the 
state to the set, and this bound is the sum of an increasing function of the size of 
the noise covariance and a decaying effect of the initial conditions. This bound can 
be achieved regardless of the possibility that inside the set some combination of the 
states accumulates the variance of the noise. This is a meaningful stability property for 
the aforementioned class of systems because the presence of persistent noise makes it 
impossible to establish in general a stochastic notion of asymptotic stability for the set 
of equilibria of the underlying differential equation. We have also studied in depth the 
inequalities between pairs of functions that appear in the various notions of Lyapunov 
functions mentioned above. We have shown that these inequalities define equivalence 
relations and have developed a complete characterization of the properties that two 
functions must satisfy to be related by them. Finally, building on this characterization, 
we have provided an alternative statement of our stochastic stability results. Future 
work will include the study of the effect of delays and impulsive right-hand sides in 
the class of SDEs considered in this paper. 
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Appendix. The next result is used in the proof of Theorem 14.61 

Lemma A.l. (Existence of bounding convex and concave functions in /Coo). Let a be 
a class /Coo function. Then the following are equivalent: 

(i) There exist so > 0 and a\,a 2 £ /Coo, convex and concave, respectively, such 
that ai(s) < a(s) < a 2 (s) for all s > so, and 

(ii) a(s), s 2 /a(s) are in 0(s ) as s —»• oo. 

Proof. The implication (i) => (ii) follows because, for any s > sq > 0, 

< m(s) < a(s) < a 2 (s) < ^^-s, 

by convexity and concavity, respectively, where cm (so), £* 2 (so) > 0. 

To show (ii) => (i), we proceed to construct cm, 0:2 as in the statement using the 
correspondence between functions, graphs and epigraphs (or hypographs). Let cm : 
R>o —► R be the function whose epigraph is the convex hull of the epigraph of a, 
i.e., epicM = conv(epia). Thus, cm is convex, nondecreasing, and 0 < cm(s) < a(s) 
for all s > 0 because R>o x R>o 7) epi cm = conv(epia) D epi a. Moreover, cm 
is continuous in (0,oo) by convexity [2y, Th. 10.4], and is also continuous at 0 by 
the sandwich theorem |ll|, p. 107] because a £ /Coo. To show that cm £ /Coo, we 
have to check that it is unbounded, positive definite in R>o, and strictly increasing. 
First, since s 2 / a(s) £ 0(s) as s —>■ 00 , there exist constants ci,so > 0 such that 
a(s) > cis for all s > s o- Now, define gi(s) = a(s) if s < Sq and gi(s) = cis 
if s > sq, and 52 ( 3 ) = — CiSq + cis for all s > 0, so that 32 < gi < a. Then, 
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epiai = conv(epia) C conv(epi</i) C epi</ 2 , because epi <?2 is convex, and thus a.\ 
is unbounded. Also, since conv(epigi) D R>o x {0} = {(0,0)}, it follows that a\ is 
positive definite. To show that a\ is strictly increasing, we use two facts: since u\ 
is convex, we know that the set in which ol\ is allowed to be constant must be of 
the form [0, b] for some b > 0; on the other hand, since a\ is positive definite, it is 
nonconstant in any neighborhood of 0. As a result, a\ is nonconstant in any subset 
of its domain, so it is strictly increasing. 

Next, let 02 : K>o —> R be the function whose hypograph is the convex hull of 
the hypograph of a, i.e., hypa 2 = conv(hypa). The function 0:2 is well-defined 
because a{s) € O(s) as s — > 00 , i.e., there exist constants C 2 ,so > 0 such that 
a(s) < C 2 S for all s > so, so if we define g(s) = C 2 S 0 + C 2 S for all s > 0 , then 
hyp 0:2 = conv(hypa) C hypg, because hype/ is convex, and thus 0 : 2 (s) < g(s). Also, 
by construction, «2 is concave, nondecreasing, and a .2 > a because hyp 0:2 2 hyp a, 
which also implies that «2 is unbounded. Moreover, is continuous in (0,oo) by 
concavity [13, Th. 10.4], and is also continuous at 0 because the possibility of an 
infinite jump is excluded by the fact that a .2 < g. To show that 0:2 G /Coo, we have 
to check that it is positive definite in R>o and strictly increasing. Note that a 2 is 
positive definite because < 22 ( 0 ) = 0 and 0:2 > a. To show that «2 is strictly increasing, 
we reason by contradiction. Assume that 0:2 is constant in some closed interval of 
the form [si,S 2 ], for some S 2 > si > 0. Then, as a-i is concave, we conclude that it 
is nonincreasing in (s 2 ,oo). Now, since 02 is continuous, we reach the contradiction 
that lim^oo a(s) < lim^oo a 2 (s) < cc 2 (si) < 00 . Hence, «2 is strictly increasing. □ 
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